human and animal
Bootstrapping Developmental AIs: From Simple Competences to Intelligent Human-Compatible AIs
Developmental AI is a bootstrapping approach where embodied AIs start with innate competences and learn by interacting with the world. They develop abilities in small steps along a bio-inspired trajectory. However, developmental AIs have not yet reached the abilities of young children. In contrast, mainstream approaches for creating AIs have led to valuable AI systems and impressive feats. These approaches include deep learning and generative approaches (e.g., large language models) and manually constructed symbolic approaches. Manually constructed AIs are brittle even in circumscribed domains. Generative AIs are helpful on average, but they can make strange mistakes and not notice them. They sometimes lack common sense and social alignment. This position paper lays out prospects, gaps, and challenges for augmenting AI mainstream approaches with developmental AI. The ambition is to create data-rich experientially based foundation models and human-compatible, resilient, and trustworthy AIs. This research aims to produce AIs that learn to communicate, establish common ground, read critically, consider the provenance of information, test hypotheses, and collaborate. A virtuous multidisciplinary research cycle has led to developmental AIs with capabilities for multimodal perception, object recognition, and manipulation. Computational models for hierarchical planning, abstraction discovery, curiosity, and language acquisition exist but need to be adapted to an embodied learning approach. They need to bridge competence gaps involving nonverbal communication, speech, reading, and writing. Aspirationally, developmental AIs would learn, share what they learn, and collaborate to achieve high standards. The approach would make the creation of AIs more democratic, enabling more people to train, test, build on, and replicate AIs.
Evaluating Visual Number Discrimination in Deep Neural Networks
Kajiฤ, Ivana, Nematzadeh, Aida
The ability to discriminate between large and small quantities is a core aspect of basic numerical competence in both humans and animals. In this work, we examine the extent to which the state-of-the-art neural networks designed for vision exhibit this basic ability. Motivated by studies in animal and infant numerical cognition, we use the numerical bisection procedure to test number discrimination in different families of neural architectures. Our results suggest that vision-specific inductive biases are helpful in numerosity discrimination, as models with such biases have lowest test errors on the task, and often have psychometric curves that qualitatively resemble those of humans and animals performing the task. However, even the strongest models, as measured on standard metrics of performance, fail to discriminate quantities in transfer experiments with differing training and testing conditions, indicating that such inductive biases might not be sufficient.
Yann LeCun's vision for creating autonomous machines
We are excited to bring Transform 2022 back in-person July 19 and virtually July 20 - 28. Join AI and data leaders for insightful talks and exciting networking opportunities. In the midst of the heated debate about AI sentience, conscious machines and artificial general intelligence, Yann LeCun, Chief AI Scientist at Meta, published a blueprint for creating "autonomous machine intelligence." LeCun has compiled his ideas in a paper that draws inspiration from progress in machine learning, robotics, neuroscience and cognitive science. He lays out a roadmap for creating AI that can model and understand the world, reason and plan to do tasks on different timescales. While the paper is not a scholarly document, it provides a very interesting framework for thinking about the different pieces needed to replicate animal and human intelligence. It also shows how the mindset of LeCun, an award-winning pioneer of deep learning, has changed and why he thinks current approaches to AI will not get us to human-level AI.
Bengio & LeCun debate on how to crack human level AI
The trio discussed the latest advancements in AI and machine learning and possible paths to human-level intelligence. "I believe we are still far from human-level AI," said Bengio. He said one of the ways to think about the gap is to look at problems humans are good at tackling compared to machines. He said we can take inspiration from how the brain switches. We know a lot about conscious processing that we can integrate into machine learning.
New theory of consciousness in humans, animals and artificial intelligence
Two researchers at Ruhr-Universitรคt Bochum (RUB) have come up with a new theory of consciousness. They have long been exploring the nature of consciousness, the question of how and where the brain generates consciousness, and whether animals also have consciousness. The new concept describes consciousness as a state that is tied to complex cognitive operations--and not as a passive basic state that automatically prevails when we are awake. Professor Armin Zlomuzica from the Behavioral and Clinical Neuroscience research group at RUB and Professor Ekrem Dere, formerly at Universitรฉ Paris-Sorbonne, now at RUB, describe their theory in the journal Behavioural Brain Research. The printed version will be published on 15 February 2022, the online article has been available since November 2021.
Consciousness in humans, animals and artificial intelligence
Two researchers at Ruhr-Universitรคt Bochum (RUB) have come up with a new theory of consciousness. They have long been exploring the nature of consciousness, the question of how and where the brain generates consciousness, and whether animals also have consciousness. The new concept describes consciousness as a state that is tied to complex cognitive operations โ and not as a passive basic state that automatically prevails when we are awake. Professor Armin Zlomuzica from the Behavioral and Clinical Neuroscience research group at RUB and Professor Ekrem Dere, formerly at Universitรฉ Paris-Sorbonne, now at RUB, describe their theory in the journal Behavioural Brain Research. The printed version will be published on 15 February 2022, the online article has been available since November 2021.
How can we tell if artificial intelligence understands our language?
This article is part of "the philosophy of artificial intelligence," a series of posts that explore the ethical, moral, and social implications of AI today and in the future. If a computer gives you all the right answers, does it mean that it is understanding the world as you do? This is a riddle that artificial intelligence scientists have been debating for decades. And discussions of understanding, consciousness, and true intelligence are resurfacing as deep neural networks have spurred impressive advances in language-related tasks. Many scientists believe that deep learning models are just large statistical machines that map inputs to outputs in complex and remarkable ways.
Unified 3D Mesh Recovery of Humans and Animals by Learning Animal Exercise
Youwang, Kim, Ji-Yeon, Kim, Joo, Kyungdon, Oh, Tae-Hyun
We propose an end-to-end unified 3D mesh recovery of humans and quadruped animals trained in a weakly-supervised way. Unlike recent work focusing on a single target class only, we aim to recover 3D mesh of broader classes with a single multi-task model. However, there exists no dataset that can directly enable multi-task learning due to the absence of both human and animal annotations for a single object, e.g., a human image does not have animal pose annotations; thus, we have to devise a new way to exploit heterogeneous datasets. To make the unstable disjoint multi-task learning jointly trainable, we propose to exploit the morphological similarity between humans and animals, motivated by animal exercise where humans imitate animal poses. We realize the morphological similarity by semantic correspondences, called sub-keypoint, which enables joint training of human and animal mesh regression branches. Besides, we propose class-sensitive regularization methods to avoid a mean-shape bias and to improve the distinctiveness across multi-classes. Our method performs favorably against recent uni-modal models on various human and animal datasets while being far more compact.
The future of deep learning, according to its pioneers
Deep neural networks will move past their shortcomings without help from symbolic artificial intelligence, three pioneers of deep learning argue in a paper published in the July issue of the Communications of the ACM journal. In their paper, Yoshua Bengio, Geoffrey Hinton, and Yann LeCun, recipients of the 2018 Turing Award, explain the current challenges of deep learning and how it differs from learning in humans and animals. They also explore recent advances in the field that might provide blueprints for the future directions for research in deep learning. Titled "Deep Learning for AI," the paper envisions a future in which deep learning models can learn with little or no help from humans, are flexible to changes in their environment, and can solve a wide range of reflexive and cognitive problems. Above: Deep learning pioneers Yoshua Bengio (left), Geoffrey Hinton (center), and Yann LeCun (right).
Global Big Data Conference
Deep neural networks will move past their shortcomings without help from symbolic artificial intelligence, three pioneers of deep learning argue in a paper published in the July issue of the Communications of the ACM journal. In their paper, Yoshua Bengio, Geoffrey Hinton, and Yann LeCun, recipients of the 2018 Turing Award, explain the current challenges of deep learning and how it differs from learning in humans and animals. They also explore recent advances in the field that might provide blueprints for the future directions for research in deep learning. Titled "Deep Learning for AI," the paper envisions a future in which deep learning models can learn with little or no help from humans, are flexible to changes in their environment, and can solve a wide range of reflexive and cognitive problems. Deep learning is often compared to the brains of humans and animals.